INVARIANT DIFFERENTIAL OPERATORS AND FCR FACTORS OF 

ENVELOPING ALGEBRAS 



IAN M. MUSSON AND JEB F. WILLENBRING 

Abstract. If g is a semisimple Lie algebra, we describe the prime factors of U(g) that have enough 
finite dimensional modules. The proof depends on some combinatorial facts about the Weyl group 
which may be of independent interest. We also determine, which finite dimensional W(g)-modulcs 
are modules over a given prime factor. As an application we study finite dimensional modules over 
some rings of invariant differential operators arising from Howe duality. 



1. Introduction 

1.1. Let F denote an algebraically closed field of characteristic zero, and let U = U(q) be the 
enveloping algebra of a reductive Lie algebra q over F. Starting with the pioneering work of Soergel 
( |Soe90| ). there has been some effort to understand the prime spectrum X = SpeciU) (see [BJOlj . 
[P05J, |PJ). The key open problem is to determine the order relations between prime ideals. 

Intersections of prime ideals are important in relating the algebraic and topological properties of 
X. For example, if P G X, then P is primitive if and only if P is locally closed in X (see |Dix96| . 
8.5.7). We can formulate this result as follows, for PgI, set 

X(P) = {Qe X\P c Q}. 

(Throughout this paper we use the symbol C to denote proper inclusion.) Then exactly one of the 
following holds: 

(1) P is primitive, 

(2) P = C\q£X(P) Q 

Now set Y(P) = {Q G X(P) \ dimU/Q < oo}. In view of the above it is natural to ask when P 
is equal to f]Q £Y (p) Q- This is closely related to the property that U/P is an FCR-algebra, (we 
recall the definition shortly). In fact, it is easy to see that if g is semisimple then U/P is FCR if 
and only if one of the following mutually exclusive conditions hold: 

(3) dimU/P < oo, 

(4) P = n Q eY(P)Q- 

1.2. Given an F-algebra A, we say that A has enough finite dimensional representations if the 
intersection of the annihilators of the finite dimensional j4-modules is zero. If in addition all finite 
dimensional representations are completely reducible A is an FCR algebra (see [KS94J). 

Let q be a semisimple Lie algebra with enveloping algebra U(q). In this paper, we describe the 
prime factors of U(g) that are FCR algebras, in terms of Soergel's theory. If A is a prime factor 
of U(g), then any finite dimensional ^4-module is a 53-module, and hence completely reducible. So 
the issue is whether or not A has enough finite dimensional modules. This last condition has the 
following topological interpretation. For any algebra A, let 

A = Hm{A/I\ dim A/I < 00}, 
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the pro-finite completion of A. Then the natural ring homomorphism A — > A is injective if and only 
if A has enough finite dimensional modules. 

1.3. We begin with some basic notation used to state the main theorem. Suppose that g is a 
reductive Lie algebra. Let q ss = [g,g], be the semisimple part of g. Fix a Cartan subalgebra f) of g 
and set f) ss = f) n Q S s- Then, t) = h ss © 3 where 3 is the center of g. 

Let R denote the root system corresponding to the pair (g, f)) with Weyl group W. Choose a set 
of positive roots, R + , such that R = R + U —R + , and let B = {a±, ct2, • • • , a n } denote the simple 
roots in R + . 

Set p := 2 Sae_R+ a > an d define the "dot action" of W on f)* as w.£, := + p) — p for £ E h* 
and u; E W. The dot action of W on fj* induces an action on S. Let k( , ) denote the Killing form 
on g ss . For p E fj*, let /i^ be the element of f) ss determined by nih^, h) = p{h) for all h E f) ss . The 
isomorphism h* s ~ h ss sending // to ^ induces a bilinear form ( , ) on fj* s . Recall that this form is 
positive definite on the real span of the roots. For a E R let H a = denote the coroot to a, 
and set a v = tJ^h . Let uJj E f)* s be the fundamental weights, so that (uJj,aJ) = We write H{ 

(resp. /ij) in place of H ai (resp. /i a J. Thus p{Hi) = (p,a^). 

Each A E h* determines a subroot system, R\ = {a E i?|(A,a v ) E Z}. Let W> denote the 
Weyl group of R\. Let B\ be the unique basis of simple roots in R^ := R + n i?A, and set 
iy A := E W|i«(J3^) C The elements of W x are left coset representatives for W\ in W. 

Thus, W = T^ a Wa. 

1.4. To any prime ideal f2 of 5 = <S(h), the symmetric algebra on h, we can associate a prime ideal 
Ifi of U, and a "tautological highest weight" A := Aq (see|Soe90j. We recall the details in Section 
[3l Any prime ideal of U has the form Iq for a suitable prime ideal f2 in <S. Set IAq, :=U/Iq. 

For p E ()*, let L(//) be the simple module with highest weight p. Let 

P+ = {p e t)*\ dim L(p) < 00}. 

We say that p is dominant if E P + . We say that a prime ideal is strongly dominant ifV(0,)f]P + 
is Zariski dense in V(O), where V(O) denotes the zero set of f2 in h*. If is strongly dominant 
then f2 is dominant as defined in [P], see Lemma [3.21 

Main Theorem. Assume g is semisimple andlA = U{q). 

(1) IfU^i is FCR then for some w E W , w.Q is strongly dominant. 

(2) Let ft be a strongly dominant ideal in S, and w E W . 
The following conditions are equivalent: 

(a) U w . n is FCR 

(b) I w .n = In 

(c) w E W x where A = Aq. 

If g is reductive we can still give sufficient conditions for U to have enough finite dimensional 
representations, see Proposition 14.41 and Lemma 14.51 

This paper is organized as follows. In Section [2] we prove some results about root systems and 
the Weyl group which may be of independent interest. Then in Section [3] we collect some results 
about prime and primitive ideals in enveloping algebras. The main theorem is proved in Section 
HI In Sections [5l [6l and [71 we apply our results to some examples of rings of invariant differential 
operators related to Howe duality. 

2. Weyl group combinatorics 

We introduce some notation. Let B\ be a subset of B, R\ be the subroot system of R with 
simple roots B\ and let Rf be the corresponding set of positive roots. Let W\ be the Weyl group 
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of Ri and set 

P = 2 a - 

For w eW define: 

Q(w) = {a G i? + |wa G , 
and set i(w) = \Q{w)\. We have ( |GW98| Lemma 7.3.6), 

p-w~ 1 p= a - (!) 

Lemma 2.1. Suppose w €W is such that w(Ri) = R\ and set 

T(w) = {a G Rf\wa G -Rf}. 

Then, 

p - w p = 2^ «• 

Proof. Note that i^J 1 " is a disjoint union i^J 1 " = w(Rf\T(w)) U (-wT(w)). The rest of the proof is 
similar to the proof of ([T|) . □ 

Proposition 2.2. Suppose that w and w(R\) = R±. Then 

with equality if and only if w{B\) = B\. 

We introduce some notation needed for the proof of this result. If Q is a finite subset of [)* we 
set (Q) = EaGQ"- Let 

W = {w G P^K-Ri) = 

Lemma 2.3. For w G Wo following are equivalent, 

(1) w(B 1 ) = B 1 , 

(2) loOBi) C fl+ 

(3) ^(ws a ) > £(w) for all a G B\. 

Proof. Clearly (1) implies (2). For the reverse implication, suppose f3 G Rf and write = 
Y^ ae B 1 c "«- Define ht(J3) = i2 a c a . From (2) it follows that ht(w{(3)) > ht((3) and w(Rf) = Rf. 
This implies that w~ 1, y G B\ for 7 £ Bj. Hence (1) holds. The equivalence of (2) and (3) follows 
from [Hu90j Lemma 1.6 a), b). □ 

Corollary 2.4. Set T = {w G W\w(Bi) = B ± }. Then, 

(1) Wq = W\T is the semidirect product of the normal subgroup W\ by T. 

(2) For w G W\ andtGT we have i(wt) = £{w) + t{t). 

Proof. (1) Since W\ is generated by reflections, s a with a G B\ and ts a t~ x = s t r a -s for t G T, 
it follows that T normalizes Wi. From the implication (1) ==>■ (3) in Lemma 12.31 and [Hu90j 
Proposition 1.10 (c) we see that T is a transversal to W\ in Wq. It follows easily that Wq = W\T 
is the semidirect product of W\ by T. 

(2) This holds by [Hu90j Proposition 1.10 (c). □ 



Recall that if w G W and a G B such that £(ws a ) = £(w) + 1 we have Q(ws a ) = s a Q(w) U {a} 
(|GW98| Corollary 7.3.4). If w\,W2 G W and £(w\W2) = £{w\) + £(w2), it follows by induction on 
£(102) that Q(wiW2) = w 2 ~ 1 Q(wi) U Q{w2), a disjoint union. Now for t G T and w G Wi we have 
= £(w) + £(i) by Corollary [M Since V = p', it follows that 

(p',(Q(wt))) = (p',{Q(w))) + (p',(Q(t)))- 

Hence Proposition 12.21 follows from the following result. 

Let v be the longest element of W\. Then, v{R J [) = —Rf and since £(v) = \R^\, we have 
v{R + \R^) = R + \R^. Note that v 2 = 1, and if t G T, then since t~ l vt G W\ and t^vt^Rf) = -Rf 
we have tv = vt. Suppose t G T, and set 

g+ = {aGQ(t)|(/ ) »>0}, 
Q - = {a G Q(t)\(p',a) < 0}. 

Lemma 2.5. 

(1) IfweWi then Q(w) = T(w). Hence, ifw^l, then (//, (Q(w))) > 0. 

(2) The map k : a va is a permutation of Q(t), which interchanges Q + and Q~ . 

(3) IfteT, then (p',(Q(t)}) = 0. 

Proof. (1) Obviously T(w) C Q(w), and it follows from |Hu90| Corollary 1.7 and Proposition 1.10 
(b) that £(w) = \T(w)\, giving equality. The second statement follows from ([GW98 Lemma 
2.5.12). 

(2) First observe that if a G Q(t) then a £ Rf, since t(Rf) = Rf hence ta = —(5 with (3 G R + \Rf . 
We must show that va is in R + and tva G —R + . The first statement follows since v(R + \Rf) = 
R + \Rf , and the second follows from tva = vta = —vf3 G —R + . We have shown that k is a 
permutation of Q(i). Finally, for a G 

(p',va) = (vp',a) = -(/£>', a). 

The result follows easily from this fact. 

(3) follows immediately from (2). □ 
Next we relate the dot action of W on <S to the usual action. 

Lemma 2.6. If h G f) and u> G i/ien, 

w.h = wh— h(a). 

Proof. For AG f)* we have, 

(w./t)(A) = hiw^.X) 

= h(w- 1 (X + p)-p) 
= (wh)(X) + h(w~ 1 p- p). 
We now apply equation dU). □ 



3. FCR FACTORS OF ENVELOPING ALGEBRAS. 

We recall Soergel's work on prime ideals in the enveloping algebra U = U(q) where q is a reductive 
Lie algebra. Let Z denote the center of U. 

If R is a ring we let Spec(i?) denote the prime spectrum of R. For ft G Spec 5, define an ideal Iq 
in SpecU as follows: Let F := Quot(S/Q) (the quotient field of the commutative domain defined 
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by Q). We will let gp = F ®F denote the Lie algebra obtained from g by extension of scalars. We 
write An for the F-linear map from fjp to F whose restriction to fj is: 

X Q : fj 5 -» S/fi F. 

Let L(A^) be the simple highest weight module for gp with highest weight Aq. Let Jq be the 
annihilator of L(Aq) in W(g) and set 4>(£l) = In- The maximal ideals in S have the form, := 
{/ G S\f(fi) = 0} for /i G f)*, and we write 1^ instead of Im^i so that 1^ is the annihilator of the 
simple module L(fi) with highest weight fi. We write f) F for fj* (g> F = (fjp)*- 

For P G Speck/, let ?/>(P) = PflZ (e Spec-E). Lastly, denotes the map induced by the 
Harish-Chandra isomorphism Z — > iS 1 ^ C 5. Then (by [Soe90] . Section 2.1) we have the following 
commutative diagram: 

Spec S 



Spec 




Spec Z 



By [Soe90] Section 2.2, these maps are continuous in the Jacobson topology on prime ideals. In 
particular these maps preserve inclusions. 

Remark 3.1. When A = Ajj we have: 

R\ = {a G R\H a - n£(] for some n G Z}. 

In this situation we define Kt = {a G R\\H a — n for some n G N}. In [PI . the ideal Q is called 
dominant if Rt C 

Lemma 3.2. 7/ SI zs strongly dominant then Q is dominant. 
Proof. If Q is not dominant, then 

H a + (p, a v ) — m G 0, 
for some a ^ i? + and m G N. If (5 = —a and n = —m, then for [i G V(O) we have 

(p,/3 v )=n-( / 9,/3 v )<0, 
so V(O) PI P + = 0, and is not strongly dominant. □ 

Note that the sets R\, W\, P>\ depend only on the coset A := A + P(R) G t)^/P(R). For a coset 
A, let B\ = R>\ for any A G A. 
Set 

A+ = {A G A|(A + p,a v ) > 0, Va G B A } , and 
A++ = {A G A|(A + p, a v ) > 0, Va G £ A } . 

Lemma 3.3 ( [Jan83] Satz 5.16). If w G VF A then for all fj, G A + P(i?) we We 7^ = I w ^ 

We recall the definition of the r-invariant for primitive ideals. For w G W, set 

t\(w) = {a G -BaK'-o G — . 

Next define X\ = {I w .\\w G W}, and write 2 Ba for the poset of subsets of B\ ordered by inclusion. 
We have: 
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Theorem 3.4 f [Jan83] Satz 5.7). Let A G \j*/P(R) and A G A ++ . Then there is a well defined 
order reversing map: 

such that t\(I w ,x) = t\(w). 

Lemma 3.5. Let D be a dense subset of an affine algebraic set X . Let: 

X = Xi U X 2 U X 3 U • • • U X r 
be the decomposition of X into irreducible components. Then D n Xj is dense in Xi for each i. 

Proof. Consider % such that 1 < % < r. There exists a function pi G 0{X) which vanishes on Xj 
for all j i and pi is not identically zero on Xi. Let / G 0{Xi) be a function that vanishes on 
D n Xi. We will show that / is identically zero on Xi. We may extend / to a function g G 0{X). 
The function gpi vanishes on D and so is identically zero on X. On Xj, = _fpj. This means 
that / vanishes on the set D' = {x G Xi\pi{x) ^ 0}, which is dense in Xi. Therefore, / vanishes 
on Xi. □ 

4. Proof of the main result. 

Until further notice q will be a reductive Lie algebra over F. In general, it is unknown when a 
prime ideal is contained in a given primitive ideal 1^. However for fx G P + the answer is easy. 

We recall the definition of Joseph's characteristic variety | Jo77j . Let p : U — > be the 

projection defined by the decomposition 

U = U(#) © (n~W + ^n+). 

For / an ideal of U, set V(J) = V(p(J)). 

Lemma 4.1. Suppose I, J are ideals oflA and Vt is a prime ideal of S. 

(1) If I Q J thenY(J) C V(I). 

(2) //i/eV(Jfl) thenI n CI u . 

(3) V(n) C V(Jn). /n particular, p G ¥(/,,). 

(4) V(Jn) C W.V(n). 

Proof. The proofs are easily adapted from |Jo77] (Lemma on page 103). □ 
Theorem 4.2. For /i G P+ ; C I M ?/ and onZy j/ W./z n V(O) / 0. 

Proof. Using the Lemma one can justify the steps below. 

(=>): If 7 n C 1^, then ^ G V(/^) C V(J n ) C W.V(fi). Therefore, Wyu n V(fi) ^ 0. 
(<J=): If u>./x G V(O) for some w G W, then w./j, G V(In) since V(f2) C V(Jn)- Therefore, since 
M G P + , In C I Wmfi C J M . 

□ 

Definition 4.3. Set A(Q) := {// G C J m }, and for each w G W, set 

A(n,u>) := {/i G G v(n)}. 

Note that, Iq C P| M eA(n) ^" ana - equality holds if and only if Uq is FCR. Also, by Theorem 14.21 we 
have: 

A(J2) = |J A(n,iu). 

Proposition 4.4. // f2 is strongly dominant then has enough finite dimensional modules. 
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Proof. If P + n V(fi) is dense in V(0) then I n = f\ te p+nV(Q) T » h Y lSoe90| Proposition 1. Thus by 
the remark after Definition 14.31 h suffices to show that P + n V(O) C A(O) because this will imply 
D^eAffi) If* — ri M eP+ nV(n) h>-- The former inclusion follows since if p, G P + D V(f2) then f2 C M^, 
so In C 1^, because preserves inclusions. □ 

Lemma 4.5. //SI is a strongly dominant ideal in S, and w G VF A where X = Xn then I w .n = In- 
Proof. If w 6 W x , then I\ = I w \ by Lemma 13.31 Thus, In = I w o by [Soe90j Theorem 1 part 
(ii)- ' □ 

For the remainder of this section we assume that g is semisimple. 
Proposition 4.6. If Q, is strongly dominant and X = Xn, then B\ C B. 

Proof. Let B = {a\, ■ ■ ■ ,a n }. It suffices to show that if a G R\ H R + and a = Ya=1 c * a * ( Ci ^ 
Z, Cj > 0) then Cj > implies on G i?A- Now a G i?A means i7 Q — m' G for some wl G Z. 
If /j. G V(f2) H P + we have pj = p(Hj) G N for 1 < j < n. Also, /i a = ^Cjhj. We can write 

i/ a = Yl where s,rj € N, s > are such that = Cj ^'"^ ■ Then, m' = p(H a ) = -f-^'' 
Hence, if q > 0, then r« > and < «, < = m. 

Suppose Q > 0, and for < p < m, let Hj )P := V(flj— p). The above establishes that V(f2)(~lP + C 
U^qILj,. Since O is strongly dominant, V(O) C U^Lo^i.p, but V(O) is irreducible so V(f2) C 11^ p 
for some p. This means Hi — p G f2, so ctj G D 

To prove an important special case of the main theorem. Before proceeding however, observe 
that for any ideal fiC5 and w € W we have: 

V(>ft) = wV(fi), and V(w.Q) = w.V(Q). 

Furthermore, if tt' is an ideal such that V(f2') = V(O) + p, then for any w G VF, V(tf$l') = 
w.V(£l) + p. In addition H a — n G implies -ff Q — n — (p, a v ) G ST. 

Theorem 4.7. Suppose and u;.^ are prime ideals of S such that P + n V(£l) and P + n V(u;.f2) 
are nonempty. Then w G iy A , where X := Xn is the tautological highest weight corresponding to Q. 

Proof. Suppose that p G P + fl V(J1) and v G P + fl V(u>.Sl). Assume to the contrary that w G W is 
such that there exists a G B\ such that raa = —(3 for /? G Since a G I?a we have H a — n G £1 
for some n G Z. Because /i G P + n V(ri), it follows that p{H a — n) = 0, and p(H a ) G N. This 
implies that n G N. Similarly — m G u>.f2 for some m G N. 

Let ii' be the ideal in S defined by the closed algebraic set V(f2) + p. Then H a — n — (p,a v ) G SI', 
and so -w(H a -n-(p, a v )) = Hp + n + (p : a y ) G u>f2'. Since G V(w.Q) = w.V(Q) = V(wQ') - p, 
we have, v + p £ V(w£l'). Therefore, 

(v + P ){H /3 + n+(p,a v ))=0, 
since an element of wQ' evaluates as on V(w£l'). This means that: 

m + (p,/3 v ) + n+ (/9,a v ) = 0, 
But this is a contradiction because (p,~f v ) > for all 7 G R + . □ 

In the next two lemmas we assume that SI is strongly dominant and A = Xn- By Proposition 
14.61 B\ C B. Thus, we may apply the results of Section [2] with B\ replaced by B\ etc. Let / the 
subset of {1, 2, • • • , £} such that B\ = {a-i\i G /}. 

Lemma 4.8. Assume that SI is strongly dominant and X = Xn- Then if w G W, w(R\) = R\ and 
w{B x ) 2 ^a then 

w.hpi = whpi — c. 

for some c > 0. 
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Proof. By Lemma 12.61 

w.hpi = wh p i — h p i{ a )- 

Since S7 is strongly dominant B\ C B by Proposition 14.61 Therefore by Proposition 12.21 c := 
V(£aeQ(«0«)>O- D 
Lemma 4.9. If w & W and w.Q, = SI f/ien w(B\) = B\. 

Proof. Suppose that w.Q = Q. We proceed in two steps. 

Step 1. w(R\) = R\: Indeed, if a € R\, then H a — m G SI for some m G Z. If u;a = /? then by 
Lemma 12.6} S7 contains 

-m) = Hp- (7, a v ) - m, 

7 eQ(u.) 

and this implies that /? G .Ra. 

Step 2: Since the a, (i € /) belong to there are non-negative rational numbers cij (i G /) such 
that: 

/lj — <2j G SI 

similarly, — a G S7 for some non-negative a G Q. By Lemma 12. II we have 

— p' = wa = ~ 

«gt(«j) ie/ 

for non-negative integers 6j. Hence, 

= hp' — y~] 6j/ij. (2) 
iel 

Assume for a contradiction that w(B\) <£. B\. Then by Lemma [2. 3 1 u>( .EM % Rt, so by Lemma l4.8( 

w.hpi = whp> — c (3) 

for some c > 0. Since w.fl = SI, it follows from equations (|2|) and ([3]) that contains, 

w.{hpi — a) = whpi — a — c 

= hp/ — hhi — a — c. 
iei 

However, hi — a% G fl for i G /, so 

hp/ — ^i a i — a — c £ Q. 
iei 

Since h p > — a G S7 we deduce that 

+ c G S7. 

iei 

This is a contradiction since c > and 6j, aj > for all i G J. □ 

Theorem 4.10. // t/n' FCi? i/iere exists a strongly dominant ideal Q in S such that SI' = u>.Sl 
for some w G W x (where X := Xq is the tautological highest weight of CI). 

Proof. Let 



X := A(W) = X x U • • • U X r 



define the decomposition of X into irreducible components. Set Y{ := A(f2') n Xj. Since Uqi is 
FCR, and A(fi') = |J*i, 

fi€A(W) 4=1 /i6Yj 

Because Ify is prime, we have that Iq/ = fl^ey, f° r some i . Let denote the ideal of elements 
vanishing on Xj. Note that Yi is dense in X% for each i since A(O') is dense in X (see Lemma 13,51) . 
Therefore In 1 = /q by [Soe90] Proposition 1. This implies that 6 (In') = 0(Iq), and therefore by 
|Soe90j Theorem 1 part (i) we have f2' = w.Cl for some w G W. 

Because A(O) n X, is dense in Xj, and A(O) C P + , it follows that P + n A(0) is also dense in 
Xj. Therefore is strongly dominant. Since In = I w .n, the proof of jSoe90] Theorem 1 part (ii) 
shows that there exists wi GW such that w ■ O = uii.O and I\ = I Wl .\. It follows from Lemma 14.91 
that w(B\) = B\. Hence to prove the result it is enough to show that w\ G W x . 

Write w\ = uv with u G W x , v G W\. By Lemma [3731 we have I Wl .\ = I v .\. Hence I\ = I v ,\. By 
Theorem I3.4( t\(v) = ta(1). This implies that v = 1, since ta(1) = and if i> 7^ 1 and u = us a is a 
reduced decomposition in W\, then a G r\(v). Therefore, w\ = u G TV A . □ 

Lemma 4.11. Suppose Vt, £l\ G Spec 5 and Zei A, Ai respectively be the tautological highest weights. 

(1) If 9,i = v.n with v G W x then B Xl = vB x . 

(2) // in addition, u G W Xl then uv G W x . 

Proof. (1) From remark \3. II we see that 

v(R\) = {a G — m G ft for some m G 

and one can check that v(R\) = R\ 1 . Since v G TV A , 

vS A Cfi+n # Al = i2+ . 

This fact implies that vR^ C ifj" , and therefore R Xl D N = • Since there is a unique choice 
of simple roots in K£ , the result follows. 

(2) If a G B\, then t>a G B Xl by part (1). Hence uva G -R + for all such a, so w G W x . □ 

Proof of the Main Theorem. (1) this follows from Theorem 14.101 
For (2) assume £1 is strongly dominant, and w G W. 

(b) => (a): If I w .q = In, then U w .n is FCR by Proposition |4~41 

(c) ==>■ (b): This follows from Lemma 14.51 

(a) ==> (c): Suppose that U w .n is FCR. By Theorem 14. 10} there is a strongly dominant prime fii, 
and u G W Al such that w.£l = u.Q\, where Ai is the tautological highest weight corresponding to 
fij. If I? = u~ l w, then and v.Q, are strongly dominant, so by Theorem 14. 7\ v G W x . By Lemma 
14.111 we have w = uv G VF A . □ 

5. Invariant differential operators 

An interesting class of examples arises from dual pairs ([GW98] Section 4.5, [How89j, [LS89]). 
The application of our method is fairly routine, so we give only the most interesting examples 
rather than conduct an exhaustive study. 

Let M Pt k denote the set of p x k matrices over F, and consider cases A,B,C as follows. 
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Case 


K 


V 


Action of K on V 





A 


GL k (F) 


M Pik x M Kq 


(g, (a,b)) i ^ (ag- L ,gb) 




B 


O k (F) 


M k>n 


{9, a) >-> 5« 


SP2n 


C 


S P 2k(F) 




(5, a) 1 ^ 5a 


so 2n 



In case A we set n = p + q. If p = (resp. q = 0) we set V = M k , n (resp. V = M n> k). In all cases 
the algebra of invariant differential operators T>(V) is generated (as an associative algebra) by a 
Lie algebra isomorphic to g. Hence there is a surjective homomorphism 

4,:U^)^V{V) K . (4) 

The image of g under <\> is described explicitly on pages 69-70 of [LS89] . 

Let T be a maximal torus of K. In [MRJ , it is shown that if zero is not a T- weight of V then 
V(V) K has enough finite dimensional representations. Thus if g is semisimple, then T>(V) K is FCR 
since it is an image of U{g). We remark that zero is not a weight of V in cases A and C of the 
above table and in case B for even k. 

There is a multiplicity free decomposition of 0(V) as a F[K] ® ^(g)-module ([GW98] Theorem 
4.5.14). Furthermore, as a W(g)-module, 0(V) is a direct sum of simple highest weight modules. 
Let 

A = {A € f)*|0(V) has a g-submodule isomorphic to L(X)}. 
If f2 is a radical ideal of S, and S7j , • • ■ , Clt are the prime ideals of S that are minimal over Q, we 
set I n = n\ =1 In v 

Lemma 5.1. If £1 is the radical ideal of S such that V(f2) = A, the Zariski closure of A, then 

ker(j) = In- (5) 

Proof. Suppose that A = X\ U • • • UXt is the decomposition of A into irreducible components, and 
for 1 < i < t, let be the prime ideals of S such that V(fij) = X%- By Lemma |3.5| Aj = A n Xi is 
dense in Xi, and so by ( |Soe90j Proposition 1) we have: 

In, = P| ann u L(\) 

for 1 < i < t. Therefore, since OiV) is a faithful £><y) K -module and A = \J \ =1 Aj we have: 

ker <f> = {u € U\4>{u)0(V) = 0} 

= P| ann u L(\) 
AeA 
t 

= P| P| ann u L(\) 
i=l XeAi 

= In- 

□ 

Note that Iq is a completely prime ideal. We identify a situation where it is zero. 
Theorem 5.2. Assume that rank g < rank K then li = T>(V) K . 

Proof. Let \Un} be the usual filtration on U and {D^} the Bernstein filtration on T>(V). Then K 
preserves each Dn, so acts on grT>(V) and gr (T>(V) ) = (grX>(V)) . Now g maps onto F)^ and 
this induces a surjection £/jv — > with kernel In C\Un- Passing to the associated graded rings 
we obtain a surjection 

= grU -» ^(^) X = <s(y ® y*)^ 
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with kernel grl^ . Then if rank K > rank g then we can apply the Second Fundamental Theorem of 
Invariant Theory in the free case ([GW98J Corollary 4.2.5) to V @V* . We conclude that grin = (0) 
so I n = (0). ' □ 

Our next aim is to describe the irreducible constituents of 0(V) as a iT-module and as a U(q)- 
module. With this goal in mind we set up some standard notation. 

By a partition we will mean a finite sequence of weakly decreasing non-negative integers. We 
will denote partitions by lower case Greek letters. The length of a partition is denoted £(a) = 
max{i|aj > 0}. The conjugate of a partition A is a partition A' whose i th part is given by \{j\Xj > 
Note that £(X) = X[. 

The highest weights of representations of q (resp. K) are given by m-tuples where m is the rank 
of g (resp. K). The m-tuple (ai,--- ,a m ) corresponds to the weight YliLi a i e i where the e« are 
defined in Section 2.3.1 of |GW98j . 

At this point we consider the cases separately. 



6. Case A 

As a basis for f) we take {Ei, • • • , E n } where E% is the nxn matrix with a 1 in the row i, column 
i entry and zeros elsewhere. 

Given non-negative integer partitions a and j3 with 1(a) < p, £((3) < q, and £(a) + £((3) < k, let 
Vt a fi\ denote the irreducible Ql n (F) module with highest weight: 

(a,(3) g := (-k - a p , -k - a p -i, ■ ■ ■ , -k - ai,0i,fo, ■ ■ ■ ,f3 q ) . 

V ' 

n 

Let V^ a '^ denote the irreducible representation of GL^ with highest weight: 

(a,j3) K ■= (ai,a 2 ,--- ,a p ,0,--- ,0, -f3 q ,--- ,-02,-Pi) ■ 
v v ' 

k 

Lemma 6.1. There is a multiplicity free decomposition under the joint action of K and q we have 
the multiplicity free decomposition: 



0(V) = (8) V { 



where the direct sum is over the set 



W k (p,q) := < 



(a, (3) 



(«,/3)> 



a and (3 partitions such that 
i(a) < p, £([3) < q, and 
£(a)+£([3) < k 



Proof See |EW04j p. 356. □ 



Define Af-(p,q) = {(a, f3) s \(a, (3) € Wk(p,q)}, and let Zf~(p,q) := A/,(p,q) denote the Zariski 
closure of these weights. 
If k < n define: 

{(E k+1 ,E k+2 , ■ • • ,E n ), ifm = 0; 

(E\ + k,"- ,E m + k,E m+k+ i, ■ ■ ■ ,E n ), if < m < n - k; 
(Ei + k, - ■ ■ , E n _ k + k), if m = n — k. 

Lemma 6.2. The decomposition of Z k (p,q) into irreducible components is as follows: 
(1) Z k (p,q) = t)*, ifn<k. 

li 



(2) Ifk <n< 2k, then 



Z k (p,q)= (J V(fl r 



where: 



(3) If2k<n then 



where: 



{0, • • • ,p}, ifp<n- k; 

& p = I {0, • • • , n — A;}, if n — k < p < k; 

{p — k, ■ ■ ■ , n — k}, if k < p < n. 

Z k (p,q)= U V ^ 



{0, • • • ,P}, ifp < k; 

®p={ {p-k,--- ,p), ifk<p<n-k; 
{p — k, - ■ ■ , n — k}, if p > n — k. 

Proof. Statement (1) follows because if n < k, then 0(V) contains the irreducible Ql n (F) module 
with highest weight (a,f3) s for any partitions a, (3 with 1(a) < p, and t(0) < q. For statements (2) 
and (3) we define, for < i < p 

Wt(p,q) = {(a, 13) G W k (p,q)\£(a)=p-i}, 

and 

Ai(p,q) = {(a,P) g \(a,P) G W k (p,q)}. 

Suppose (q, (3) € W^p, q). Then, < i < p since < £(a) < p. Also, £(a) < k implies that 
p—k<i. In addition, the set of weights (a, /3) such that £(a) = p—i and i((3) < k—£(a) = k+i—p 
is contained in the Zariski closure of the set of weights (a, [3) s with l((3) = k + i — p. Since we require 
that 1(0) < q, we can restrict our attention to the highest weights (a, (3) s such that 1(a) = p — i 
and k + i — p < q. That is, i < n — k. It follows that Z^(p, q) ={_] A.\(p, q) where the union is over 
all i such that max(0,p — k) < i < mm(p, n — k). It is easy to check that for these values of i, 
A-kiP'l) = V(fij). The result follows by considering individual cases. □ 



Proposition 6.3. If n and k are fixed, then for 0<i<j<n — k we have Iq 4 = Io Jj . Moreover, 
Oq an d Q n -k are strongly dominant. 



Proof. To see that is strongly dominant note that 

k 

'mi c v(n ) = J^FcJi. 



k 

i=l i=l 



Similarly Q n -k is strongly dominant. Now set Q = £l n -k, so that: 

Q = (E 1 + k, E 2 + k, ■ • • , E n _ k + k), 
and let A = Aq. For < i < n — k we define Wi £ W = S n by: 

{j, for 1 < j < i; 

j + k, for i + 1 < j < n — k; 

j — n + k + i, for n — k + 1 < j < n. 

Then, it is easy to see that Wi.Q = Qi, and that Wi G W x . The result follows from the Lemma 
1451 □ 

Remark 6.4. Explicit generators for Iq are given in |Pro04| using Capelli identities. 
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7. Cases B and C 



We first turn our attention to Case B. 
Lemma 7.1. There is a multiplicity free decomposition under the joint action of K and g given by 

Q{V) = 07"® 

neM 

where we index the summands by the partitions [x in the set: 

M := {[i is a partition such that + fJ,^ < k and I := fi\ < n} . 
The highest weight of the sp2 n - m odule, is given by: 

. k k k k . 

(- 2 ' ~ 2 ' ' " ' ~2 ~ M'"' ' ~ 2 ~ 



n 

Proof See |EW04j p. 353. □ 

We describe the Zariski closure, Z in ()* of the set of weights of G(V) as a g-module. If k > 2n 
then Z = f)*, so we consider the case where k < 2n. For k odd, we can see using Theorem 14.21 that 
D(V) K has no finite dimensional modules, so we consider the k even case. 

Suppose that k = 2p. Fix i with 1 < i < min(p, n — p) and set r = n — p — i, s = n — p + i. Then 
define 

&i = {H\,H2, • • • , H r -.i,H r + 1, H r+ i, • • • , H s _i,H s + H s+ i + • • • H n + p + 1). 
We also set 

= (Hi, • • • , H n - p ^i,H n - p + H n - p+ \ + • • • + if n + p). 
Lemma 7.2. T/ie decomposition of Z into irreducible components is given by 

min(p,n— p) 

z= y v(no. 

Proof. For < i < min(p, n — p), set 

Mj = {// is a partition such that + // 2 < &, and ^ = p + i}. 

and let Aj C f)* be the set of highest weights of the modules with /j, G Mj. Note that if 
Mi + ^2 < ^ = 2p and // x < p then the highest weight of is in Ao- 

If < i < j < min(p, n — p) neither of the ideals f2j, Qj is contained in the other. Therefore, it 
suffices to show that the Zariski closure of Aj is V(Oj). Suppose that fj, G M{ and let a = Yli=i aiti 
be the highest weight of V^. Then m = —p for \ <i<r = n — p — i, and aj = —p — 1 for 
r + \<i<s = n — p + i. The result follows easily. □ 

Note that GK-dim <S/f2j = p — i, where GK-dim is the Gelfand-Kirillov dimension. Let Ii = 
for < i < p. 

Recall the homomorphism from equation (JH). 

Lemma 7.3. We have ker cj) = Iq. 

Proof. By Lemma 15. 1|. ker cf) = (q =Q Ii. Since ker cj) is prime, it follows that I{ C ker (j) C J for some 
i. Hence ^ fl 2 C / n 2, that is f2j n Z C fig n i?. If i > 1 then since S is a finitely generated 
^-module we would have: 

p-i = GK-dim(S/a) = GK-dim(Z/Z n Qt) 

> GK-dim(Z/Z nQ )=p 
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a contradiction. 



□ 



We show next that U/Iq is FCR. To do this define 



— {Hp+i, ■ ■ ■ 



H n ) 



and define w 6 W so that if a 



(ai, • • • , a n ) G h*, we have lo(a) = b, where: 




for 1 < i < n — p; 
for n — p + 1 < i < n. 



It is easy to check that is strongly dominant, w.Q = f^o and w £ W where A = Aq. Thus by 
the main theorem, Iq = and IAq is FCR. We expect that 



with all inclusions strict. If p = 1 this follows from Lemmas 15.11 and 17.31 

Case C is relatively uninteresting, the Zariski closure V(f2) of the set of highest weight occurring 
in 0(V) as a g-module is irreducible. Also Uq = D(V) has enough finite dimensional modules 
from [MR] and thus is FCR. Furthermore, V(f2) = f)* if and only if n < k. 
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